Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structure

نویسندگان

چکیده

Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive has been widely leveraged in as an effective mechanism enhance the discriminative capacity of learned representations. However, complex structures KG make it hard construct appropriate pairs. Only a few attempts have integrated strategies with KGE. But, most them rely on language models ( e.g., Bert) for pair construction instead fully mining information underlying structure, hindering expressive ability. Surprisingly, we find that entities within relational symmetrical structure are usually similar and correlated. To this end, propose knowledge framework based relation-symmetrical KGE-SymCL, which mines KGs ability KGE models. Concretely, plug-and-play approach is proposed by taking positions positive Besides, self-supervised alignment loss designed pull together Experimental results link prediction entity classification datasets demonstrate our KGE-SymCL can be easily adopted performance improvements. Moreover, extensive experiments show model could outperform other state-of-the-art baselines.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning Entity and Relation Embeddings for Knowledge Graph Completion

Knowledge graph completion aims to perform link prediction between entities. In this paper, we consider the approach of knowledge graph embeddings. Recently, models such as TransE and TransH build entity and relation embeddings by regarding a relation as translation from head entity to tail entity. We note that these models simply put both entities and relations within the same semantic space. ...

متن کامل

On Contrastive Divergence Learning

Maximum-likelihood (ML) learning of Markov random fields is challenging because it requires estimates of averages that have an exponential number of terms. Markov chain Monte Carlo methods typically take a long time to converge on unbiased estimates, but Hinton (2002) showed that if the Markov chain is only run for a few steps, the learning can still work well and it approximately minimizes a d...

متن کامل

Background Knowledge in Learning-based Relation Extraction

In this thesis, we study the importance of background knowledge in relation extraction systems. We not only demonstrate the benefits of leveraging background knowledge to improve the systems’ performance but also propose a principled framework that allows one to effectively incorporate knowledge into statistical machine learning models for relation extraction. Our work is motivated by the fact ...

متن کامل

Knowledge-Based Interpretation of Road Maps Based on Symmetrical Skeletons

f' scanner raw.dataS ' 5 The objective of our research reported here is to show the various processing steps on all levels of a computer vision system required to interpret and describe road maps. First, the foundation for the recognition process is laid by computing two sets of distance skeletons. They are termed endoand exo-skeleton and are symmetrical with respect to the boundary between for...

متن کامل

Personal Knowledge/Learning Graph

Educational data mining and learning analytics have to date largely focused on specific research questions that provide insight into granular interactions. These insights have been abstracted to include the development of predictive models, intelligent tutors, and adaptive learning. While there are several domains where holistic or systems models have provided additional explanatory power, work...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering

سال: 2023

ISSN: ['1558-2191', '1041-4347', '2326-3865']

DOI: https://doi.org/10.1109/tkde.2023.3282989